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CN ; Abstract 

^ f We study the problem of maximizing a monotone submodular set function subject to linear packing 

■^ I constraints. An instance of this problem consists of a matrix A G [0, 1]'"^", a vector 6 G [1, oo)"\ and a 

monotone submodular set function / : 2["1 -^ M+. The objective is to find a set S that maximizes f{S) 
subject to Axs < b, where xs stands for the characteristic vector of the set S. A well-studied special case 
of this problem is when / is linear This special case captures the class of packing integer programs. 

Our main contribution is an efficient combinatorial algorithm that achieves an approximation ratio 
^^ . of ^(l/m^/^), where W — min{&.j/Ay : A^j > 0} is the width of the packing constraints. This 

\—\ ' result matches the best known performance guarantee for the linear case. One immediate corollary of this 

C/3 . result is that the algorithm under consideration achieves constant factor approximation when the number 

of constraints is constant or when the width of the constraints is sufficiently large. This motivates us to 
study the large width setting, trying to determine its exact approximability. We develop an algorithm that 
CN ' has an approximation ratio of (1 — e)(l — 1/e) when W — n{\nm/e^). This result essentially matches 

^ . the theoretical lower bound of 1 — 1/e. We also study the special setting in which the matrix A is binary 

and fc-column sparse. A fc-column sparse matrix has at most k non-zero entries in each of its column. We 
\^ . design a fast combinatorial algorithm that achieves an approximation ratio of n{l/{Wk^^^)), that is, its 

ff^ ■ performance guarantee only depends on the sparsity and width parameters. 
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1 Introduction 

Let / : 2'-'^' — > M be a set function, where [n] = {1,2,..., n}. The function / is called submodular if and 
only if f{S) + /(T) > f{S U T) + f{S n T), for all 5, T C [n]. An alternative definition of submodularity 
is through the property of decreasing marginal values. Given a function / : 2^^^ -^ M and a set S* C [n\, the 
function fs is defined by fsij) = f{S U {j}) — f{S). The value fs{j) is called the incremental marginal 
value of element j to the set S. The decreasing marginal values property requires that fs{j) is non-increasing 
function of S for every fixed j. Formally, it requires that fs{j) > frij) for all 5 C T. Since the amount 
of information necessary to convey an arbitrary submodular function may be exponential, we assume a value 
oracle access to the function. A value oracle for the function / allows us to query about the value of f{S) for 
any set S. Throughout the rest of the paper, whenever we refer to a submodular function, we shall also imply 
a normalized and monotone function. Specifically, we assume that a submodular function / also satisfies 
/(0) = and f{S) < f{T) whenever S C T. 

In this paper, we focus our attention on the problem (or rather class of problems) of maximizing a mono- 
tone submodular set function subject to linear packing constraints. Formally, the input of this problem consists 
of a matrix A G [0, 1]™^", a vector h G [1, cxo)™, and a monotone submodular set function / : 2["1 -^ M_|_. 
The objective is to find a set S that maximizes f{S) subject to Axs < b, where xs stands for the characteristic 
vector of the set S. We note that the domain restrictions on the entries of A and h are without loss of general- 
ity since arbitrary non-negative packing constraints can be reduced to the above form by first eliminating any 
element j for which there is some constraint i such that Aij > bi, and then scaling the input (see, e.g., the 
discussion in [37]). A well-studied special setting of our problem is when the objective function / is linear, 
namely, there is a weight vector c G M" such that f{S) = Ylj^s ^r ^^^^ special setting captures the class of 
packing integer programs, which models many fundamental combinatorial optimization problems, including 
maximum independent set, hypergraph matching, and disjoint paths. 

Previous work. Submodular functions play an instrumental role in computer science, economics, and oper- 
ations research as they form a rich class that is general enough to be valuable for applications, but still has 
plenty of structure to allow positive results. These properties seem to make submodulai^ functions a natural 
candidate of choice for objective functions in optimization problems. Indeed, over the last few years, there 
has been a surge of interest in understanding the limits of tractability of optimization problems in which the 
classic hnear objective function was replaced by a submodular one. 

There has been a long line of research on maximizing monotone submodular functions subject to matroid 
and knapsack constraints. Arguably, the most classic scenario is maximizing a submodular function subject to 
a cardinality constraint, that is, max{/(5) : |5| < k}. It is known that a simple greedy algorithm achieves an 
approximation ratio of 1 — 1/e for this problem [31]. Furthermore, this result is optimal in two different ways: 
(i) given only oracle access to /, one cannot attain a better approximation ratio without asking exponentially 
many value queries [30], and (ii) even if / has a compact representation, it is still NP-hard to obtain a better 
approximation result [11]. The greedy approach and its variants has been shown to be useful in additional 
constraint structures [15, 27, 6, 20]. One relevant setting is maximizing a monotone submodular function 
under a knapsack constraint [42]. A knapsack constraint is essentially a single packing constraint, and may 
be viewed as the weighted analog of a cardinality constraint. Sviridenko [38] demonstrated that a greedy 
algorithm with partial enumeration achieves an approximation guarantee of 1 — 1/e for this problem. 

Another approach that has been proven effective in handling submodular function maximization under 
different constraint structures is based on approximately solving a continuous fractional relaxation of the 
problem, followed by pipage or randomized rounding. The pipage rounding technique was originally devel- 
oped by Ageev and Sviridenko [1], and was adapted to submodular maximization scenarios by Calinescu, 
Chekuri, Pal and Vondrak [5]. Vondrak [40] utilized the continuous relaxation approach to achieve a tight 



(1 — 1/e) -approximation for maximizing a monotone submodular function subject to a matroid constraint, 
and Kulik, Shachnai and Tamir [28] used this approach to attain a (1 — e)(l — 1/e) -approximation for maxi- 
mizing a monotone submodular function under a constant number of packing constraints. Later on, Chekuri, 
Vondrak and Zenklusen [8] presented a dependent randomized rounding scheme that can be utilized to extend 
those results for maximizing a monotone submodular function subject to one matroid and constant number of 
packing constraints. Recently, Feldman, Naor and Schwartz [14] presented a new unified continuous relax- 
ation approach that finds approximate fractional solutions in both monotone and non-monotone scenarios. 

Our contribution. Our main result is an efficient multiplicative updates algorithm for maximizing a mono- 
tone submodular- function subject to any number of linear packing constraints. The approximation ratio of 
our algorithm matches the best known performance guarantee for the special case when the objective func- 
tion / is linear, which is achieved using the randomized rounding technique [35, 34, 37]. More precisely, let 
W = m.m{bi/Aij : Aij > 0} be the width of the packing constraints, we attain the following result. 

Theorem 1.1. There is a deterministic polynomial-time algorithm that attains an approximation guarantee 
ofQ.{l/m^'^)for maximizing a monotone submodular function under linear packing constraints. 

It is worth noting that our combinatorial algorithm is deterministic and efficient. Moreover, our technique 
is different than the two leading approaches used in the past for submodular maximization, namely, the greedy 
approach and the continuous relaxation approach. Our algorithm is based on a multiplicative updates method 
(see, e.g., [33, 43, 16, 2, 4]). This method is known to be fruitful for approximately solving problems that can 
be cast as linear and integer programs. Nevertheless, the analysis of these algorithms relies heavily on primal- 
dual results, which are not applicable in our submodular setting. We believe that this new approach may be 
suitable for other submodular optimization problems. We also like to remark that a comparable approximation 
guarantee may be obtained using the continuous relaxation approach applied with randomized rounding [7]. 
However, in contrast with that approach, our algorithm is deterministic, efficient and combinatorial. 

One immediate corollary of Theorem 1.1 is that the algorithm under consideration achieves a constant 
factor approximation when the number of constraints is constant or when the width of the packing constraints 
is sufficiently large, say W = O(lnm). This motivates us to study the large width setting, trying to determine 
its exact approximability. The following theorem summarizes our result in this context. 

Theorem 1.2. There is a deterministic polynomial-time algorithm that achieves an approximation guarantee 
of [1 — e)(l — 1 / e) for maximizing a monotone submodular function subject to linear packing constraints 
when W = Q(lii m / e^), for any fixed e > 0. 

We note that this result almost matches the theoretical lower bound of 1 — 1/e, which already holds 
for maximizing a monotone submodular function subject to a cardinality constraint [31, 11]. Specifically, the 
large width setting captures the hard instances of that problem. We remark that the (1 — l/e)-approximation in 
the submodular setting stands in contrast with a (1 + e)-approximation which can be achieved by randomized 
rounding when the objective function is linear and the width is sufficiently large. 

We also study the interesting special setting of the problem in which the constraints matrix is binary, 
namely, A G {0, 1}™^" instead of A £ [0, 1]™^". We demonstrate how to fine-tune our algorithm and its 
analysis to achieve an improved approximation guarantee of il(l/m^/(^"'"^)). This result is formalized in 
Theorem A.l. We like to emphasize that this result is optimal unless P = ZPP. Recently, Bansal et al. [3] 
considered the special case of maximizing a submodular function under k-column sparse packing constraints. 
In this setting, the constraints matrix has at most k non-zero entries in each column. They developed an 
algorithm whose approximation ratio only depends on the spai^sity and width parameters of the input matrix. 
Specifically, they presented a ri(l/A;^/^)-approximation algorithm that employs the continuous relaxation 
approach in conjunction with randomized rounding and alteration. We make a first step towards attaining 



their performance guarantee in a deterministic and efficient way. We present a fast combinatorial algorithm 
for the binary fe-column sparse setting whose approximation ratio only depends on the sparsity and width 
parameters of the input matrix. The following theorem outlines this result. 

Theorem 1.3. There is a deterministic polynomial-time algorithm that achieves an approximation guarantee 
ofQ.{l/{Wk^'))for maximizing a monotone submodular function under binary packing constraints. 

Other related work. The problem of maximizing a non-monotone submodular function without any struc- 
tural constraints is known to be both NP-hard and APX-hard since it generalizes the maximum cut problem. 
Feige, Mirrokni and Vondrak [12] developed an algorithm whose approximation ratio is 0.4. This result was 
iteratively improved by Oveis Gharan and Vondrak [17], and then by Feldman, Naor and Shwartz [13] to a ra- 
tio of 0.42. Lee, MiiTokni, Nagarajan and Sviridenko [29] presented a (1/4 — e)-approximation algorithm for 
non-monotone submodular maximization subject to a constant number of packing constraints. This result was 
iteratively improved by Chekuri, Vondrak and Zenklusen [9], and then by Feldman, Naor and Shwartz [14] to 
a ratio of 1/e — e. Vondrak [41], and very recently, Dobzinski and Vondrak [10] developed general approaches 
to derive inapproximability results in the value oracle model. 

Unlike submodular function maximization, the problem of minimizing a submodular function can be 
performed efficiently, either by the ellipsoid algorithm [21] or through strongly polynomial-time combina- 
torial algorithms [36, 24, 22, 32, 23, 26]. Goemans, Harvey, Iwata and Mirrokni [19] considered the prob- 
lem of explicitly constructing a function that approximates a monotone submodular function while making 
a polynomial number of oracle queries. They showed an essentially tight 0(7T,^/^)-approximate solution. 
Recently, several submodular analogues of classical combinatorial optimization problems have been stud- 
ied [39, 18, 25]. These submodular problems are commonly considerably harder to approximate than their 
linear counterparts. For example, the minimum spanning tree problem, which is polynomial-time solvable 
with linear cost functions is Q{n)-hwA to approximate with submodulai" cost functions [18]. 

2 Submodular Maximization with Linear Packing Constraints 

In this section, we develop a multiplicative updates algorithm for the problem and analyze its performance. 
An important input parameter of our algorithmic template is an update factor. This parameter plays an essen- 
tial role in achieving the desired approximation guarantees in the two settings of interest. We first consider the 
general problem, and demonstrate that there is an update factor for which our algorithm attains an approxima- 
tion ratio of VL{l/m}/^). In particular, this implies that the algorithm achieves constant factor approximation 
for input instances that have a large width, e.g., instances with W = Qihim). This motivates us to study 
this large width setting, trying to determine its exact approximability. We match (up to a disparity of e) the 
theoretical lower bound of 1 — 1/e using a different update factor and a refined analysis. 

2.1 The algorithm 

The multiplicative updates algorithm, formally described below, maintains a collection of weights that are 
updated in a multiplicative way. Informally, these weights capture the extent to which each constraint is close 
to be violated under a given solution. The algorithm is built around one main loop. In each iteration of that 
loop, the algorithm extends the current solution with a non-selected element that minimizes a normalized sum 
of the weights. When the loop terminates, the algorithm returns the resulting solution in case it is feasible; 
otherwise, either the last selected element or the resulting solution without that element is returned, depending 
on their value. Recall that fsij) = f{S U {j}) — f{S) is the incremental marginal value of element j to the 
set S, and xs is the characteristic vector of the set S. 



Algorithm 1 Multiplicative Updates 



Input: A collection of linear packing constraints defined by ^ G [0, 1]"*^" and b € [1, oo)^ 

A monotone submodular set function f : 2^"'^ —?' M4. 

An update factor A € M+ 
Output: A subset of [n] 



5^0 

for i ■(^ 1 to m do Wi -^ l/bi end for 

whUe ^^1 biWi < A and 5 y^ [n] do 

Let j ^ [n\\ S be the element with minimal YlT^i ^ij'^i/fsU) 

s^su{j} 

for z ^ 1 to m do Wj •(— WiX^^^/^^ end for 
end while 

if Axs < b then return S 

else if f[S \ {3}) > f{{j}) then return S \ {j} 

else return {j} end if 



2.2 Analysis 

In the remainder of this section, we analyze the performance of the algorithm. We begin by establishing 
several lemmas that hold independently of the value of the update factor. Later on, we consider specific 
update factors, and study their effect on the approximation ratio of the algorithm. For ease of presentation, it 
would be convenient to first introduce some notation and terminology: 

• Let S* C [77,] be a solution that maximizes the submodular function subject to the linear packing 
constraints, with value of f{S*). 

• Let St be the solution at the end of iteration t of the algorithm, and note that ^o = indicates the 
solution at the beginning of the algorithm. Moreover, let 7(t) denote the element selected at iteration 
t of the algorithm, and let 5t = f{St) — f{St~i) be its incremental marginal value to the solution. 
Finally, let wu be the value of Wi at the end of iteration t of the algorithm, and remark that Wio = l/bi 
is the value of w-i at the beginning of the algorithm. 

• Let At = Yl^ibiWit and at = Yl^LiAij{t)Wi(t-i)/^t- Notice that the algorithm may proceed to 
iteration t + 1 only if At < A, and that Aq = m. Also note that at is the value which gave rise to the 
selection of element 7(t) at iteration t of the algorithm. 

Correctness. We prove that the algorithm outputs a feasible solution. This is achieved by demonstrating that 
the returned solution respects the packing constraints. 

Lemma 2.1. The algorithm outputs a feasible solution. 

Proof. Let us focus on the solution S when the main loop terminates. Clearly, if 5 respects the packing 
constraints then the returned solution also respects them. Thus, let us consider the case that 5 is infeasible. 
We next argue that S became infeasible only at the last iteration of the loop in which element i was selected. 
Consequently, by inspecting the last two lines of the algorithm, one can conclude that the returned solution 
must be feasible as it is either 5 \ {i} or {£}. 



For the purpose of establishing the previously mentioned argument, let C be the first element that in- 
duces a violation in some constraint. Specifically, suppose I induces a violation in constraint i at iteration t. 
Accordingly, Ylji^St ^«i -^ ^*' ^^^ theretofore, 

hw^t = biWio n ^^''^'' = A^^es,^../^. > X , 

J&St 

where the last equality is due to the fact that Wio = l/6j. This implies that A^ > A, and hence, by inspecting 
the main loop stopping condition, we know that the loop must have terminated immediately after element i 
was selected. ■ 

Approximation. We turn to analyze the approximation guarantee of the algorithm. We begin by establishing 
a generic algebraic bound applicable for any monotone submodular function and any ai^bitraiy sequence of 
element additions. 

Claim 2.2. Given a submodular function f : 2^"-' -^ M+, a set collection Sq Q Si C ■ ■ ■ Q St Q [n], and a 
set S* C [n] satisfying f{S*) > f{St) then 

^ f{S,) - f{Se-i) ^ ( f{S*)-f{So) 
^j(S*)-f{Se-i)- \f{S*)-f{St) 

Proof. One should observe that for any i = 1, . . . , t, 

/(ft) -/(s«) _/■"-'' 1 .,, < f""' _ \ ,, , 



where the inequality follows by noticing that the function l/{f{S*) — x) is monotonically increasing for 
X € [0, f{S*)). As a consequence, we obtain that 

^ m) - fjSe^i) A f /(^^) 1 ^ /^("*) 1 ,, ^ 1, ( f{S*)-f{So) 

ti fiS*) - f{S,.i) - ^ y^(s,_,) f{S*) - X Jf^so) fis*) - X V fiS*) - f{St) 



We continue by bounding the value of the optimal solution using the main parameters of the algorithm at 
the end of iteration i. 

Claim 2.3. f{S*) < f{Si) + A^/a^+i in every iteration L 

Proof. We know that the element selected at iteration £ + 1 minimizes the term X]™^ ^ijWa/fsiiJ) with 
respect to every j G [n] \ S^. This cleai^ly implies that a^+i < Ya^i ^ij'^a/ fseU) for every j under 
consideration. Rearranging the terms in this inequality, we can bound the marginal value of each element 
j G [n] \ Si with respect to Sg as 

AjWii 



fsAj)<Yl 



,=1 «^+i 



Let J* = {j : j ^ S* and j ^ Sf\ be the set of elements selected by the optimal solution, but not selected by 
the algorithm up to the end of iteration L Note that J* C [n] \ Si, and notice that 



f{S*) < f{S* U Si) < f{Si) + J2 fs,{J) 



where the first inequahty follows from the monotonicity of /, and the last inequality holds as a result of its 
submodularity. Specifically, the latter inequality is obtained using the decreasing marginal values property. 
We now focus on bounding the above right-hand side term. For this purpose, we utilize the bound derived 
earlier on the marginal values of the elements in [n] \ Si, and attain 

where the last inequality follows by recalling that the elements in J* are a subset of the elements in the optimal 
solution, and thus, constitute a feasible solution respecting all constraints. As a result, ^,gj. Aij < bi. ■ 

We next demonstrate that the algorithm attains an approximation guarantee of Q{l/m^/^) when the 
update factor is A = e^m. Recall that W = min{6j/yljj : Aij > 0} is the width of the constraints. 

Lemma 2.4. The algorithm archives Q.{1 / m^' ) -approximation by using A = e tti. 

Proof. Suppose the main loop terminates after t iterations. Notice that when the loop terminates either 
St = [n] or X^ilLi ^i'^it > e^rn. In the former case, one can easily infer that the returned solution is 
1/2-approximation to the optimal solution. Specifically, if St is returned by the algorithm then the outcome 
is clearly optimal since St consists of all elements, and if one of St \ {j} or {j} is returned then the value of 
the solution is a 1/2-approximation since 

max {/(5t \ {j}), /({i})} > \ if {St \ {j}) + /({j})) > ^f{St) , 

where the last inequality uses the submodularity of /. In fact, one can easily validate that the above analysis 
also holds in case that f{St) > f{S*), which can happen since St may be infeasible. Hence, in the remainder 



w 



m. 



of the proof, we shall assume that f{S*) > f{St) and that the loop terminates with A^ = Yl^i ^iWu > e 

We concentrate on upper bounding the value of Aj. For this purpose, we analyze the change in Yl^i ^i'^i 
along the loop iterations. Observe that for any £ = 1, . . . ,t, 



m 



W^\^ii(e)/h 



i=l i=l 



m / 



^ eWm'/^A,^^,) 



i=l 



i=l i=l 



The first inequality follows by plugging a = em}'^ and y = WA^^/idbi to the inequality a^ < 1 + ay, 
which is known to be valid for any a £ M+ and y € [0, 1], and the last equality results from the definition 
of ai. By Claim 2.3, we know that an < Ae-i/{f{S*) - /(Se-i)) in case f{S*) > /(S'^-i). The latter 
condition clearly holds since f{S*) > f{St) by previous assumption, and f{St) > f{Se-i) for any i under 
consideration. Therefore, 

Ae < A^_i • 1 + — — T777^ < A^-i • exp 



f{S*) - /(5,_i) - ^-^ M f(S*) - f{Se-i) 



where the last inequahty is due to the fact that 1 + y < e^. The resuhing recursive definition can be used, in 
conjunction with the base case Aq = m, to upper bound At by 



A, < 



'^f{S*)-f{Se-i)^ 



Aone^p(7<i^:^7(s;eoj— H^""""S 



Recall that we assumed that the loop terminated with Aj > e^m. This lower bound on A^ can be utilized, 
together with the upper bound on A^, to yield 

'-™ g/(s.)-/(ft^O-"" '"l/(s-)-/(sJ' 

where the last inequality is due to the Claim 2.2. We note that f{So) = since / is normalized and 5o = 0. 
Subsequently, one can obtain that 1 — l/exp(l/em^/^) < f{St)/f{S*) using simple algebraic manipula- 
tions. This can be further simplified to l/{em^'^ + 1) ^ f{St)/fiS*) by reutilizing the fact that 1 + y < e^. 
Notice that this proves that the algorithm archives r2(l/m^/^)-approximation since the value of the returned 
solution is at least f{St)/2. This follows from arguments similar to those presented at the beginning of the 
proof. ■ 

We are now ready to complete the proof of the first main result of the paper. We note that this result 
matches the best known approximation guarantee for the case that the objective function / is linear, achievable 
using the randomized rounding technique [35, 34, 37]. 

Proof of Theorem 1.1. By Lemma 2.1 and Lemma 2.4, we know that when the algorithm uses an update 
factor of A = e^m, it constructs a feasible solution which approximates the optimal solution within a factor 

0fJ^(l/?Tll/^). ■ 

One immediate corollary of this theorem is that the algorithm under consideration attains a constant ap- 
proximation guarantee when the number of constraints is constant or when the width is sufficiently large, 
say W = Q{ln'm). In particular, one can reexamine the analysis presented in the proof of Lemma 2.4, and 
deduce that the approximation ratio of the algorithm approaches l/(2e + 2) for sufficiently large W's. A 
natural foUowup question is whether one can improve upon this result. In what follows, we demonstrate that 
we can beat this approximation ratio by a careful selection of the update factor. We present a refined analysis 
that proves an approximation ratio of (1 — e)(l — 1/e) when W = J7(ln?n/e^). In particular, our analysis 
avoids the two-factor loss due to the max-selection in the last two lines of the algorithm. 

Lemma 2.5. The algorithm achieves an approximation ratio of {1 — 4e)(l — 1/e) by using A = e""^ when 
W > niaxjln ?7i/e^ , 1/e} for any fixed e > 0. 

Proof. Suppose the main loop terminates after t + I iterations. Let us consider the case that it terminates 
with Yl^i^i'^iit+i) < e*^^. Note that this implies that 5(+i = [n]. One can also argue that S'f+i is 
the returned solution since it is feasible. The feasibility of St+i follows from ai^guments similar to those 
presented in the proof of Lemma 2.1. Specifically, one can demonstrate that if St+i violates some constraint 
i then hiWiu^i\ > e'^^ . Obviously, the returned solution is optimal as St+i consists of all elements. Hence, 
in the remainder of the proof, we shall focus on the case that the loop terminates with X^™ ^ ^i'^iu+i) ^ e.'^^ . 
We next argue that solution constructed up to and not including the last iteration, namely St, achieves the 
claimed approximation guai^antee. Note that this implies that the returned solution must also have the desired 
performance guarantee since St is feasible. The feasibility of St also follows from arguments similar to those 



exhibited in the proof of Lemma 2. 1. Specifically, one can establish that if St+i is infeasible then it became 
infeasible only at the last iteration of the loop, and thus, St is feasible. We turn to bound the value of A^. A 
lower bound can be easily obtained by noticing that 



Ate^ = Y,brWa ■ {e^'^f^ >J2^iW,(^t+i) > e' 



i=l i=l 



and therefore, Af > e^^^ ^h Similarly to the proof of Lemma 2.4, we derive an upper bound on A^ by 
analyzing the change in Yl^i ^i'^i along the loop iterations. Observe that for any £ = 1, . . . ,t, 

m m 

1=1 i=l 

™ / ^^^r A ... / ^-\M A ,,\2\ 






j=l 

m 



1=1 i=l 

= Ai^i + {eW + e^W)ae6i . 

The first inequality follows from the fact that e^ < 1 + y + y^ for any y € [0, 1], which can be derived from 
the corresponding Taylor expansion. The last inequality is obtained by using the fact that WAi^^^g^/hi < 1 to 
reason that (eWA^.^r^-^/bi)'^ < e^WA.i^.y/£\/bi. Finally, the last equality results from the definition of a^ . By 
Claim 2.3, we know that ae < A^_i/(/(5*) - f{Se-i)) when /(5*) > /(5£_i). The latter condition clearly 
holds since f{S*) > f{St) as St is a feasible solution, and f{St) > /(S^^i) for any i under consideration. 
Therefore, 

Ae < A^.i • 1 + -)—- -— ^ < Ae_i • exp ' ^ ^ ' 



f{S*) - f{Se-i)J - '-' \f{S*) - f{Se-i) 

where the last inequality is due to the fact that 1 + y < e^. The resulting recursive definition can be used to 
upper bound At by 



A.^A..ne.p(J|l±^).e.p(.V.,H^..V)E 



fiS*)-fiSe-i) 



where the last inequality holds since Aq = m < exp(e^VF) by our assumption regarding the width of the 
constraints. Recall that we previously demonstrated that A^ > ex.p{e{W — 1)). This lower bound on At can 
be utiUzed, together with the upper bound on At, to yield 

e{W -l)-e^W ^y. fjSe) - fjSe^i) ^ / f(S*)-f{So) 
,W + em -jr[f{S*)- f{Se-i) - ""{fiS*)- fiSt) 

where the last inequality is due to the Claim 2.2. Note that /(So) = as / is normalized and Sq = 0. Also 
notice that {e{W - 1) - e^W)/{eW + e^W) > (1 - 2e)/(l + e) > 1 - 3e. Subsequently, one can obtain that 
1 — l/exp(l — 3e) < f{St)/f{S*) using simple algebraic manipulations. The claimed approximation ratio 
follows by noticing that 



e 



3e 



l__>l_i±^i±^>(l_4„('l-l 

e e \ e 



where the first inequality reuses the fact that e^ < 1 + y + y^ for any y € [0, 1], and both inequalities assume 
that e < 1/4, which is the interesting range of values for e. ■ 

We are now ready to complete the proof of the second principal result of the paper. We note that this 
result almost matches the theoretical lower bound of 1 — 1/e, which akeady holds for maximizing a monotone 
submodular function subject to a cardinality constraint [31, 11]. In particular, our large width setting captures 
the hard instances of the latter problem as this problem can be solved in polynomial-time when W = 0(l/e) 
by enumerating over all sets of size at most W. 

Proof of Theorem 1.2. Given an instance of the problem in which W = Q.{him/e^) for any fixed e > 0, 
Lemma 2. 1 and Lemma 2.5 guarantee that employing the algorithm with an update factor of A = e^^'^ results 
in a feasible solution that approximates the optimal solution within a factor of (1 — e)(l — 1/e). ■ 

3 Submodular Maximization with Binary Packing Constraints 

In this section, we consider the special setting of monotone submodular maximization under binary packing 
constraints, namely, when A G {0, 1}™^" instead of A G [0, l]'"^^". Note that we may assume without loss 
of generality that b € N™ since each vector entry can be rounded down to the nearest integer without any 
consequences whatsoever. This natural setting has been considered in the past for linear- objective functions. 
Similarly to the general linear case, the randomized rounding technique attains the best known approximation 
guarantee in this case as well. In particular, it achieves an approximation ratio of n{l/m^'^^^ "i), which is 
polynomially better than the general case. This outcome is also known to be optimal unless P = ZPP [6]. 
We can demonstrate that our multiplicative updates approach from Section 2 can be utilized to obtain the 
above-mentioned improved approximation guarantee for the underlying setting. This requires a fine-tuning of 
the algorithm and its analysis. We defer these technical details to Appendix A. 

We next develop a different multiplicative updates algorithm for the special setting in which the constraints 
matrix is A:-column sparse. In this case, the number of 1-value entries in each column of the input matrix is 
at most k. We prove that our algorithm achieves an approximation guarantee that does not depend on the 
number of rows m, but only depends on the sparsity parameter k and width parameter W . More precisely, we 
establish that the algorithm attains an approximation ratio of Q.{\/{Wk^'^)). 

3.1 The algorithm 

The multiplicative updates algorithm, formally described below, maintains a collection of weights that capture 
the extent to which each constraint is close to be violated under a given solution. The algorithm is built 
around one main loop. In each iteration of that loop, the algorithm considers a remaining element whose 
marginal contribution to the current solution is maximal, and adds it to the solution set if its corresponding 
sum of weights is sufficiently small. In any case, the element under consideration is removed from the list 
of remaining elements. When the loop terminates, the algorithm returns the resulting solution. Recall that 
fsij) = f{S U {j}) — f{S) is the incremental marginal value of element j to the set S 

3.2 Analysis 

In what follows, we analyze the performance of the algorithm. We begin by establishing an algebraic bound 
applicable for any monotone submodular function and any solution set of elements, attained by an algorithm 
that considers the elements in a greedy fashion. Note that our algorithm indeed considers the elements in such 
fashion. We define the greedy elements sequence £{f,S) = (ei, . . . , e„) of a submodular function / and a 



Algorithm 2 Column Sparse Multiplicative Updates 



Input: A collection of linear packing constraints defined by ^ G {0, 1}™^" and 5 G N 

A monotone submodular set function / : 2['^1 — > M+ 

An update factor A € M+ 
Output: A subset of [n] 

S ^9,R^[n] 

for z -^ 1 to 771 do w,- ^ end for 



771 



whUe i? 7^ do 

Let j € i? be the element with maximal fs{j) 

if EI^i ^ii"^* < (A - 1) then S^SU {j} 

R^R\{j} 

for i ^ 1 to m do Wi ^ X^i^s ^^^1^^ _ i end for 
end while 
return S 



set S as the ordered sequence of elements considered by a greedy process whose outcome is 5. Specifically, 
the greedy process is initialized with Rq = [ii] and ^o = 0. Then , it runs for n steps, where in each step t, 
it considers the element et G Rt~i that has a maximum marginal value with respect to the current solution 
set 5i_i, and adds it to the solution set St of the next step if ej G 5. In any case, the element et is removed 
from Rt-i to obtain the set Rt of remaining elements for the next step. With this definition in mind, let 
Et = {ei, . . . ,et}be the set of first t elements in the sequence under consideration. 

Claim 3.1. Given a submodular function f : 2'"^ -^ IR+, a set S C [n], their greedy elements sequence 

£{f, 5) = (ei, . . . , en), and another set S* C [n] satisfying \S Ci Et\ > a ■ \S* (1 Et\for every t G [n] and a 
parameter a < 1, it holds that f{S) > {a/ {a + 1)) • f{S*). 

Proof. Let us assume without loss of generality that the greedy process goes over the elements according to 
the order 1 to n, namely, Ei = {1},E2 = {1,2}, and so on. We note that this assumption is valid since 
one can appropriately rename the elements. Furthermore, let 5 = {oi, . . . , a\s\} and S* = {bi, . . . , &|5.|} 
be the respective elements of S and 5* sorted in an increasing order. Let us suppose that 1/a is integral. We 
emphasize that this assumption is merely for simplicity of presentation, as we demonstrate later. We match 
between each element of S and 1/a distinct elements from S*. Specifically, each element at is matched to 
the elements set St = {&(t-i)/Q+i , • • • , bt/a}- Notice that every element of S* is matched to an element of S; 
else, it must be that 15*1 > \S\/a, but this contradicts the fact that \S\ = |5 n £^„| > a- 15* n £;.„| = a\S*\. 
We next argue that each at < b(^t~i)/a+i- As a result, we attain that each 

fsnEa-t-iiat) > fsnEa-t-i{b{t-l)/a+l), ■ ■ ■ , fsnEat-iih/a) ■ 

The last inequality holds since we known that when the element at was considered by the greedy process, 
all the elements of Sj* were still available, and therefore, their marginal value with respect to the solution 
S n Ea^-i was no more than the marginal value of the element at- Consequently, 



f{s*)<fis)+ Y. fsib) = /(^)+ E Y.fs(b) 

bGS'XS t=i fees* 

\s\ 



< f{S) + -J2fsnE.^-^{at)=(l + -)f{S), 
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where both inequahties hold by the submodulaiity of /. For the purpose of estabUshing the previously men- 
tioned argument, suppose by way of contradicting that there is some t for which at > fe(j-i)/Q4-i- Let us con- 
centrate on the elements set E(^^_ly^_^_l. Notice that 15" n -E(f_i)/cj+i j < t — 1, whereas \S* D -E(f_i)/Q+i | = 
{t — I) /a + 1. This implies that |5 n £'(t_i)/a+i \ < a ■ \S* H -E(f_i)/Q+i |, a contradiction. We conclude by 
noting that our assumption that 1/a is integral can be easily neglected. Specifically, one need to modify that 
proof in such a way that a fractional part of an element from S* may be matched to an element form S. Then, 
notice that at most two fractional parts of an element of T are matched to elements of S, and those elements 
must appear before the element of S* in the greedy elements sequence. ■ 

We now turn to establish our main result for the special setting of maximizing a monotone submodular 
function under A;-column sparse packing constraints. 

Proof of Theorem 1.3. We first claim that the algorithm outputs a feasible solution, namely, a solution that 
respects the packing constraints. Suppose by way of contradiction that £ is the first element that is added to 
S and induces a violation in some constraint i at iteration t of the main loop. Note that An = 1. Let St 
be the solution at the end of iteration t, and notice that J^jeS ^«i = h + ^ since all the entries of A are 
binary. This implies that Wi = X — 1 at the beginning of the iteration in which i was considered, and thus, 
Si^i ^ieWi > A — 1. Inspecting the selection rule, one can infer that £ could not have been selected. 

We next demonstrate that the algorithm attains an approximation guarantee of n{l/{Wk^^^)) when the 
update factor is A = k + 1. Recall that M^ is the width of the constraints, which is equal to min{6i} in our case. 
Similarly to before, we denote by 5* C [n] a solution that maximizes the submodulai" function subject to the 
linear packing constraints. Let (ei, . . . , e„) be the ordered sequence of elements considered by our algorithm, 
and note that it is essentially the greedy elements sequence £{f, S). Moreover, let Et = {ei, . . . , et} be 
the set of first t elements in that sequence, 5^* = S* H Et be the elements of Et in the optimal solution, 
St = S (1 Et he the elements of Et in our algorithm's solution, and wu = X^^'^^t 'j/ * — i be the value of 
Wi at the end of iteration t of the algorithm. We prove the two following claims: 

Claim 3.2. For every t G {0, . . . , n}, 

Ei=i biWit 



\St\> 



wxy^{k + x-i) 



Proof. We prove this claim by induction on t. The induction base is when the algorithm begins, i.e., when t = 
0. It is easy to see that both sides of the above expression are zero in this case. In particulars notice that all the 
weights are initialized to 0. Observe that in order to establish the induction step, it is sufficient to demonstrate 
that when an element i is selected at iteration t + 1 then 1 > Yl^i ^i ' {'^i{t+i) — Wit)/{WX^/'^ {k + A — 1)). 
For this purpose, notice that 

where the inequahty follows by plugging a = A^/^ and y = W/hi ■ (X]jG5t+i ^*i ~ '^jeSt ^«i) = W Am/hi 
to the inequality a^ — 1 < ay, which is known to be valid for any a G M+ and y G [0, 1]. As a consequence. 
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we attain that 

m m 

i=l i=l 



m 



m m 



\i=l i=l J 

where the last inequahty holds since we know that (1) element £ is selected at iteration t + 1, and thus, 
Yl^i A-iiWit < A — 1, and (2) the packing constraints are fc-column sparse, namely, the number of 1-value 
entries in each column is at most k, and hence, Y^™^i A-u < ^- ■ 

Claim 3.3. For every t G {0, . . . , n}, 



sn < \st\ + 



X-l 



Proof. Clearly, |5j*| < |5(| + jS'f* \ 5t|. Now, notice that every element j G 5^* \ St was not selected by our 
algorithm when it was considered in step t' + 1 since YliLi A-ijWit' > A — 1. since the weights may only 
increase during the run of the algorithm, we can infer that 

rn m m 

(A - 1) • \si \St\< Yl Yl ^*i^^* = Z] ^** Yl ^^j - Yl ^^*^^ ' 

where the last inequality holds by recalling that the set S* \ 5( is a subset of the optimal solution, and hence, 
constitute a feasible solution respecting all constraints. As a result, J2jeS*\s ^ij < 6i- ■ 

We can now utilize the above claims and get that for every t G {0, . . . , n}, 

|5n < 15,1 + Sl^^ < |S,| + iI^iqi±A^|S,| = (l + ^H'aV-) . |S,| . 

where the last equality holds as A = /c + 1. Therefore, we can employ Claim 3.1 with a = 1/(1 + 2WX^^^), 
and attain that the solution of our algorithm approximates the optimal solution to within a factor of at least 

a/{a + 1) = 1/(2 + 2WX^/^) = n{l/{Wky^)). ■ 

Acknowledgments: The authors thank Chandra Chekuri, Ilan Cohen, Gagan Goel, and Jan Vondrak for 
valuable discussions on topics related to the subject of this study. 
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A Submodular Maximization with Binary Packing Constraints 

We study the special setting of monotone submodular maximization under binary packing constraints, that is, 
when A e {0, l}™><" instead of ^ e [0, l]"^><". Note that we assume without loss of generality that b € N"\ 
We demonstrate that our multiplicative updates approach from Section 2 can be utilized to attain an improved 
approximation guarantee for the underlying setting. Specifically, we prove the following theorem. 

Theorem A.l. There is a deterministic polynomial-time algorithm that achieves an approximation guarantee 
of Q{l/m^'^^~^^>) for maximizing a monotone submodular function under binary packing constraints. 

Our approach for treating this case is identical to that of the general case. We employ a multiplicative 
updates algorithm that is identical to the algorithm presented for the general case with two exceptions: 

1. Line 3: the first condition is changed to Yl^i ^iWi < A instead of Yl^i ^i'^i ^ -^• 

2. Line 6: the weights update is changed to Wi ^ WiX^^^/^^^'^^^ instead of Wi •«— imjA"^'^/^'. 

We now prove that the modified algorithm for the binary case outputs a feasible solution and attains the 
claimed approximation ratio. Essentially, these results follow the analogous proofs of the general case with 
some minor adjustments. 

Lemma A.2. The modified algorithm outputs a feasible solution. 
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Proof. Let us focus on the solution S when the main loop terminates. Clearly, if S respects the packing 
constraints then the returned solution also respects them. Thus, let us consider the case that S is infeasible. 
We next argue that S became infeasible only at the last iteration of the loop in which element £ was selected. 
Consequently, by inspecting the last two lines of the algorithm, one can conclude that the returned solution 
must be feasible. 

For the purpose of establishing the previously mentioned argument, let £ be the first element that induces 
a violation in some constraint. Specifically, suppose i induces a violation in constraint i at iteration t. This 
implies that ^.g^^ Aij = &j + 1 since all the entries of A are binary. Therefore, 

jeSt 

where the second equality is due to the fact that Wio = 1/bi. This implies that Yl^i hwu > A, and hence, 
by inspecting the (modified) main loop stopping condition, we know that the loop must have terminated 
immediately after element £ was selected. ■ 



Lemma A.3. The modified algorithm archives Q.{l/m}'^^^^') -approximation by using A = e^^^ 



m. 



Proof. Suppose the main loop terminates after t iterations. Notice that when the loop terminates either 
St = [n] or "^^dLi biWit > e^^^m. One can easily demonstrate that in the former case, and in fact whenever 
f{St) > f{S*), the returned solution is 1/2-approximation to the optimal one. Thus, in the remainder of the 
proof, we shall assume that f{S*) > f{St) and that the loop terminates with A^ = J2^i ^i'^it ^ e^^+^m. 

We concentrate on upper bounding the value of Aj. For this purpose, we analyze the change in X^™ ^ biWi 
along the loop iterations. Observe that for any £ = 1, . . . , i, 



m 



A^ = ^ biWif, = ^ biWi(^i,_i) ■ (e^+ V) 



W+l^\^i-t(l)/iPi + '^) 



4=1 i=l 

m 



< E &.-.(.-!) -(^1 + ^-^^ j 

m m 

j=l i=l 

The first inequality can be obtained by plugging a = em}-'^^^' and y = {W + l)Aj^(^)/(6j + 1) to the 
inequality a^ < 1 + ay, which is known to be valid for any a € M+ and y G [0, 1], while the last equality 
results from the definition of an. By Claim 2.3, we know that ai < A£_i/(/(S'*) — f{Se-i)) in case 
f{S*) > fiSe^i). The latter condition clearly holds since f{S*) > f{St), and f{St) > f{Se^i) for any £ 
under consideration. Therefore, 

Ai < A,_i • 1 + ^ ,,^J ,,^ , < A,_i ■ exp ' ^ ^ ' ' 



/(5*)-/(5,_i) J - ^-^ -y f{S*)-f{Se^i) ;' 

where the last inequality is due to the fact that 1 + y < e^. The resulting recursive definition can be used, in 
conjunction with the base case Aq = m, to upper bound A^ by 

'"-"''■ J};"" [ /(s-)-/(s.-.) j = "' ■ ^"■^ i,'"' + ''™ g /(5-)-/(5,-.) j ■ 
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Recall that we assumed that the loop terminated with A^ > e^+^m. This lower bound on Aj can be utilized, 
together with the upper bound on At, to yield 

1 < emV(W^+i) V- fJSj) - fjSi-i) i/(W+i) 1 ( fiS*)-f{So) \ 

where the last inequality is due to the Claim 2.2. Noting that f{So) = 0, one can use simple algebraic 
manipulations and obtain that l/(em^/(^+i) + 1) < f{St)/f{S*). U 
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